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We describe a geometric-combinatorial algorithm that allows one, using solely the 
system of weights and roots, to determine the Hesselink strata of the null-cone of a 
linear representation of a reductive algebraic group and calculate their dimensions. In 
particular, it provides a constructive approach to calculating the dimension of the null- 
cone and determining all its irreducible components of maximal dimension. In the case 
of the adjoint representation (and, more generally, a ^-representation), the algorithm 
turns into the classification algorithm for the conjugacy classes of nilpotent elements in 
a semisimplc Lie algebra (respectively, homogeneous nilpotent elements in a cyclically 
graded semisimple Lie algebra). 

1. Introduction 

Below all algebraic varieties are taken over an algebraically closed field k of characteristic 
zero. 

$_i ' Let G be a reductive algebraic group and let V be a finite-dimensional algebraic G- 

module. A vector v € V is called a Hilbert nullform (cf. [He2]; other terms are unstable 
vector, [Mu], nilpotent vector, [PV]), if any G-invariant polynomial function / on V that 
vanishes at also vanishes at v. The closed subscheme M G v of V defined by vanishing of 
all such / is called the null-cone ofV. Hilbert was the first who found that the null-cones 
play a fundamental role in the theory of invariants and its applications, see [Hi]. In the 
general case, the null-cone has a complicated structure; it may be irreducible, reducible, or 
nonequidimensional, and may have complex singularities. 

According to the Hilbert-Mumford criterion, [Hi], [Mu], a vector v £ V is a nullform 
if and only if there is a one-parameter subgroup A : k x —> G that steers v to (i.e., 
such that limt_+oA(i) • v = 0). In 1978, when solving different problems, several authors 
simultaneously revealed the key role of those A that do it "most optimally", see [Bo], [Ke], 
[Hei], [He2], [Ro] (however, for V = Lie(G), where the null-cone coincides with the cone 
of nilpotent elements, this fact was revealed in a different form already in [Dy]: indeed, it 
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was found out later, see [He2], [Hei], [SI], that the "characteristics" of nilpotent elements 
introduced in [Dy] can be equivalently defined in terms of the optimality property). The 
formalization of this property is performed by introducing an Ad(G)-invariant norm on the 
set of all one-parameter subgroups: optimal subgroups are those that have the minimal 
norm. Technically, it is more convenient to consider a wider class of virtual one-parameter 
subgroups, [Hei], [He2], which is actually the set Lie(G)(Q) of rational semisimple elements 
in the Lie algebra Lie(G). The norm is defined by the choice of an Ad(G)-invariant inner 
product ( , ) on Lie(G) that is rational-valued and positive definite on the Q-vector space 
Lie(T)(Q) for a certain (and thereby for any) maximal torus T in G. If A(v ) is a family of 
all optimal virtual one-parameter subgroups corresponding to a nullform v, then, following 
[He2], we can consider the following equivalence relations on the set of all nullforms: 

x ~ y <^=^ A(g • x) = A(y) for a certain g G G. 

The equivalence classes form a finite partition of the null-cone N G v and are called strata. 
Note that, in general, the strata depend on the choice of the norm. It is remarkable that, 
although the null-cone N G v itself has a complicated structure, the configuration of the 
strata turns out to be simple: Hesselink [He2] proved that each stratum S is an irreducible 
subvariety of the null-cone N G y, open in its closure S, and there exists an isomorphism 
ip of the stratum S onto an invariant open subset of a homogeneous vector bundle E over 
G/P, where P is a parabolic subgroup in G (all these objects depend on S); in particular, 
S is a smooth rational variety. Moreover, there exists a morphism tt : E — > S, which is a 
resolution of singularities of the variety S and is such that 7r| 7r -i(5) = l P~ 1 - In particular, 
this gives a resolution of singularities for each irreducible component of the null-cone Af G v 
and shows that, using Kempf's terminology, [Ke], the latter is obtained by collapsing of a 
homogeneous vector bundle over a generalized flag variety of the group G. Note that, in 
general, the closure of a stratum is not a union of strata. 

Developing the idea outlined in [P03, (2.2.22)] we consider in this paper the problem of 
constructive description of strata. This problem has been already discussed in [He2, Sec- 
tion 5], but has not been solved there: concerning the directly related problem of finding 
out if a given saturated set is the closure of a blade (see [He2] for the meaning of these 
terms; we will not use them any longer), Hesselink writes that it "is more difficult" and 
restricts the analysis to a certain necessary condition. In the present paper we show that 
the family of all strata of the null-cone M G v is completely determined only by the geometric 
configuration of two finite subsets of the Euclidean space Lie(T)(Q), namely, the system 
of weights of the G-module V (endowed with their multiplicities) and the system of roots 
of the group G, and we obtain a simple geometric-combinatorial algorithm for describing 
this family; this algorithm employs only elementary geometric operations, namely, the 
orthogonal projection of a finite system of points onto a linear space and taking its convex 
hull. Technically, the procedure is reduced to constructing certain oriented rooted trees by 
means of these operations and assigning plus or minus signs to the vertices of these trees 
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according to a certain rule. The strata are defined precisely by the trees to whose roots is 
assigned a plus sign. 

More precisely, this algorithm allows one to describe constructively the following objects: 

(a) a certain finite subset & in Lie(T)(Q); 

(b) a certain linear subspace V[l + ] in V for every element l£6; and 

(c) a certain open subset U[Z + ]° in V[Z + ], 

such that the sets G ■ V\l + \ , where I runs over (3, exhaust, without repetition, the family 
of all strata of the null-cone N G v . 

In this case, the dimension of the stratum G • V[l + ]° turns out to be equal to the sum 
of the number of roots lying the half-space {v G Lie(T)(Q) | (/, v) < 0} and the number of 
weights (taken with their multiplicities) lying the half-space {v G Lie(T)(Q) | (l,v) ^ 1}. 
This yields a simple constructive approach to calculating the dimension of the null-cone 
N G y\ it is equal to the maximum of the above sums taken over all I from ©. Calculating 
dim M GV is a nontrivial problem; for example, the problem of classifying equidimensional 
representations and that of classifying representations with a free module of covariants, 
[Poi], [Ad], [Sci], [Lii], are reduced to the above problem; their solutions are actually 
based on developing various ad hoc methods for estimating d\mN GV . Until now, general 
information on d\m.N GV has been restricted to various a priori bounds of this number 
based on the Hilbert-Mumford criterion, see[Poi], [Sci], [SC2], [Ad], [Ka2]. 

Moreover, this also yields a simple and constructive method for describing all irreducible 
components of maximal dimension of the null-cone Mq V - they are exhausted, without 
repetition, by varieties G ■ V[l + ], where I is an element for which the above maximum is 
attained. 

The algorithm can be applied for composing a computer program for the constructive 
description of all strata, calculating their dimensions, calculating the dimension of the null- 
cone, and describing all its irreducible components of maximal dimension. The operating 
rate of such a program is determined by its part related to sorting out all the subsets of the 
set of weights. For G = T, the system of weights may be any finite set of characters, so such 
looking over is inevitable. But if G is noncommutative, the Weyl group provides nontrivial 
symmetries of the system of weights, which can be used for improving the enumerative part 
of the program. 1 

In the case of the adjoint representation, and, more generally, of a so-called 6>-represen- 
tation (see [Vii], [Ka2], as well as [PV, 8.5] and [Lii]) our algorithm turns into the algorithm 
of classifying conjugacy classes of nilpotent elements in a semisimple Lie algebra and, re- 
spectively, of homogeneous nilpotent elements in a cyclically graded semisimple Lie algebra 

1 Added in September 2010: Jointly with N. A'Campo a computer implementation of this algorithm 
has been composed in 2005. Pro tempore the code can be obtained on request sent to the address 
norbertacampo@gmail.com. But we hope to compose also the relevant comments for publishing and posting 
both on the web. 



3 



(see below Proposition 5). Although these classifications, obtained in [Dy] and [Vii], [V12] 
by a different method, are known, it would be interesting to derive (and check) them again 
in nonserial cases by a computer program based on our algorithm. This, in particular, 
applies to the classification of nullforms in the spaces of 3- vectors of a 9-dimensional space, 
[VE], 4- vectors of an 8-dimensional space, [An], spinors of 14- and 16-dimensional spaces, 
[P02], [AE], and to certain other classifications. In fact, each of the cited results can be 
considered as the solution, in the case under consideration, of the classification problem for 
the strata of the null-cone. Let us mention another important case when the classification 
problem has also been solved, [LB]: it is the case of the diagonal action of the group GL n 
by conjugation on the space of m-tuples of n x n-matrices. 

The final section contains examples of application of the algorithm. We discuss the 
cases of rank ^ 2, ternary forms, and nilpotent elements in semisimple Lie algebras (the 
case of a special simple Lie algebra of type G2 is considered in detail) and in spaces of 
^-representations. In this section we also analyze an example of a certain action of GL2 
which shows that, in general, strata depend on the choice of the norm and may not coincide 
with orbits if there are only finitely many orbits in the null-cone. 

2. Strata 

Since the nullforms for the actions of the group G and its identity component in V are the 
same, we will assume that G is a connected group. The space V is assumed to be nonzero. 

2.1. First, we shall introduce certain notation and conventions. 

Let S be an algebraic torus. The group Hom(5, k x ) of its rational characters is a free 
abelian group of finite rank. We consider it in additive notation and denote by s M the value 
of the character fi G Horn (S, k x ) at point s G S. 

Let s := Lie(5). The map Hom(5, k x ) — > s*, yu. 1 — >- d e fi, is an embedding. We identify 
Hom(S', k x ) with the image of this embedding. Then, Hom(S', k x ) is a lattice of full rank 
in s*, so that its linear span over Q is a Q-form of the vector space s*. Let s(Q) be the 
Q-form of the Lie algebra s defined by this span: 

s(Q) := {s G 5 I l(s) G Q V / G Hom(S, k x )}. (1) 

For any algebraic 5-module L and character \i G Hom(5, k x ) we set 

L M := {/ G L I s ■ I = sH V s G S} 

and denote by A L s the system of weights of S in L, 

A^-diGHom^,^) I L^O}. 

Then, L = 0^ g a l ^u- The multiplicity of the weight n in the S- module L is the number 
dim L u . 
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2.2. Let T be a maximal torus in G and t := Lie(T). Fix an Ad(G)-invariant inner 
product ( , ) on g := Lic(G) whose restriction on t(Q) is rational- valued and positive 
definite. The Weyl group W GT := Norc(T)/T, considered as a group of transformations 
of the space t, carries t(Q) into itself, and the restriction ( , )| t (Q) is W G ^-invariant. This 
restriction uniquely defines the inner product ( , ). Any rational- valued positive definite 
W G T -invariant inner product on t(Q) is obtained as such a restriction. In what follows, we 
assume that the strata of the null-cone N G v are defined by the norm on Lie(G)(Q), which 
is defined by the inner product ( , ). 

We identify t with t* by means of the map t — > t*, 1 1— > (t, •). Then Hom(T, k x ) becomes 
a lattice of full rank in t(Q). Henceforth, we consider t(Q) as a Euclidean linear space over 
Q with respect to the inner product ( , }Lq)- 

2.3. We have the following decomposition: 

y= v ( 2 ) 

veA VT 

Since maximal tori are conjugate and their union is dense in G, the action of G on V is 
trivial if and only if A VT = {0}. 

If V is the adjoint G-module g, then A gT = U {0}, where $ 9i t is the system of 
roots of the Lie algebra q with respect to the torus T. We have dimg Q = 1 V a G & s ,t, 
g = t and 

s = te 0a- (3) 

2.4. Let I e t(Q) be a nonzero element. For any number 7 G Q we set 

{/ = 7 } := {t G t(Q) I (l,t) = 7}. 

{Z ^ 7}, etc. are defined similarly. 

The element I determines in g the following algebraic subalgebras: 

t[l]:={tet\(l,t) = 0}, g[/]:=t[/]© Qa , p[/]:=t© g Q . (4) 

Let T[l], G[l] and P[l] be connected algebraic subgroups of the group G with the Lie 
algebras t[Z], g[Z] and p[l], respectively. G[l] is a reductive group, T[l] is its maximal torus, 
and P[l] is a parabolic subgroup in G. It follows from (1) and (4) that 

t[Z](Q) = {Z = 0}, cj> 0[i] , TH = d> fl ,T n t[Z](Q), g[Z] a = g a V a G <I> gW , T[/] . (5) 

The element Z also determines the following linear subspaces in T^: 

^]:=0 V„ V[l+]:= F M , (6) 
Me{/=i} /iG{«>i} 
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Relations (4) and (6) imply the G[l] -invar iance of V[l] and the P[l] -invar iance of y[i + ]. 

2.5. Let 

V[l + ] ~>V[l\, BHft/, 

be the projection parallel to Me {/>i} V^. Consider in V[l] the null-cone Mg[i],v[i] and in 
the open P[/]-invariant subset 

V[l+f := {v eV[l + ]\v> iN G[l]y[l] } (7) 

In general, the set V[Z + ]° may be empty. By (7), its noneptiness is equivalent to the 
inequality 

JWh^M- (8) 

Definition. A nonzero element I G t(Q) is called a stratifying element if condition (8) 
holds. 

2.6. Suppose that I is a stratifying element from t(Q). Then, the variety F[Z + ]° is 
nonempty. Let G x p ^W[l + }° be the space of the homogeneous bundle over G/P[l] with the 
fiber Consider the morphism 

Gx p Mv[l + ]°^V, [ g ,v]^g-v, (9) 

where [g,v] is the image of the point g x v under the quotient morphism G x V[Z + ]° — > 
G x p Wy[/+]°. Let H[l] be the image of morphism (9), 

H[l] := G ■ V[l + ]°. (10) 

Theorem 1. 

(1) If I 6 t(Q) is a stratifying element, then 

(a) H[l] is a stratum of the null- cone May that is different from {0}; 

(b) morphism (9) isomorphically maps G x p ^V[l + ]° onto H[l]; 

(c) G • V[l + ] is the closure ofU[l\. 

(2) Any stratum of the null-cone May that is different from {0} has the form ~H[l] for 
a certain stratifying element I. 

(3) H[h] = T-Llh] if and only if l\ and I2 lie on the same W GT -orbit. 

Proof. See [PV, Theorem 5.6] (see also [SI, Prop. 1], [Ne, Proof of Theorem 9.2], [Ki, Remark 
12.21]). □ 

Since dimG x p ^V[l + }° = dimG/P[Z] +dimV[/ + ]°, formulas (2), (3), (4), (6), (7), 
claim (l)(b) of Theorem 1 and the one-dimensionality of the root subspaces g Q imply the 
following corollary. 
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Corollary 1 (formula for the dimension of a stratum). 

dimWfl = #{/ < 0} n $ g , T + Yl d[mV »- ( n ) 

Me{/>1} 

In turn, since the strata are open in their closures and the number of strata is finite, 
we obtain the following corollary from (2) and (11). 

Corollary 2 (numerical criterion for the openness of a stratum in V). The following 
properties of a stratifying element I G t(Q) are equivalent: 

(a) the stratum H[l] is open in V , 

(b) dimH[/] = dimV, 

(c) #{/ < 0} n $ SiT = E^<i } dimV M . 

A stratifying element I with these properties exists if and only if May = V. 
Finally, the inclusion C V yields the following corollary. 
Corollary 3. If an element I of t(Q) is a stratifying element, then 

#{/ < 0} n $ 0>T < dimV ^- (12) 

2.7. In the next section we will show that the family of all stratifying elements in t(Q) is 
completely determined only by the geometric configuration of the system of weights A VT 
(endowed with their multiplicities) and the system of roots 3> g ,T i n the Euclidean space 
t(Q), and obtain a simple geometric-combinatorial algorithm for describing this family. 

Namely, this algorithm allows one to describe constructively a finite set & of nonzero 
elements I G t(Q) such that V[l + ] / for every I £ & and that the sets G ■ V[l + }°, where / 
runs over &, exhaust, without repetition, the family of all strata in M G v that are different 
from {0}. By Theorem 1 this yields the following description for the null-cone: 

^G,v= {JG-V[l + }. (13) 

This description is constructive in the sense that our algorithm constructively describes all 
linear subspaces V[l + ] from (13). Since the application of this algorithm to the Gf^-module 
V[l] for I G & yields a constructive description, analogous to (13), of the null-cone 
we obtain from (7) a constructive description for every stratum G ■ V[l + }°. 

In view of Corollary 1 to Theorem 1 , the constructive description of the set & also yields 
the following constructive method for calculating the dimension of the null-cone N G v by 
means of calculating the number of roots and weights (with multiplicities) in appropriate 
half-spaces of the space t(Q) : 
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Proposition 1. 

dimA/^y = max{#{! < 0} n $ g , T + Yl dimV ^}- ( 14 ) 

In addition, Corollary 1 to Theorem 1 yields a constructive method for describing all 
irreducible components of maximal dimension of the null-cone M G v : these components are 
exhausted, without repetition, by the varieties G ■ V[l + ], where / G & is an element for 
which the sum #{/ < 0} n $ Bj t +X^e{z>i} (nm V» attains its maximum. 

2.8. In some important cases, it is a priori known that the strata are orbits. For 
example, this is so for adjoint representations and, more generally, for ^-representations 
(see below Proposition 4). In these cases, the number of orbits in the null-cone N GV 
is finite, and our algorithm turns into the classification algorithm for these orbits. The 
following proposition can be used (see below Example 5) for describing the representatives 
of such orbits. 

Proposition 2. Consider a T -weight basis {v{\i & [ in V and a set {X a £ Q a \ X a /0,a£ 
&b,t} such that, for any i and a, the coordinates of the vector X a ■ Vi in the basis {vi}i<zi lie 
in Q. Let I be a stratifying element from t(Q) and J := {i £ I \ Vi £ V[Z]}. Then, for any 
family of constants {cj 6 k \ j G J} that are algebraically independent over Q, the vector 
v := Ylijej c j v i ti es i n the stratum 7~L GV . 

Proof. By construction, v G V[l]. By (7) and Theorem 1 the proof boils down to checking 
that viM my[l] . 

The family {vj}j £ j is a basis in V[l]. Let {xj}j & j be the dual basis in V[l]*. The 
monomials of degree d in {xj}j e j form the basis of the space fc[V[Z]]d of homogeneous 
polynomials of degree d on V[l]. For a 6 {I = 0}, the element X a acts linearly on /c[V[Z]]d, 
and it follows from the hypothesis that its matrix has rational coefficients in this basis. 
Since the algebra of G[l] -invariants on V[l] coincides with {/ G &[V[Z]] | Lie(G[/]) • / = 0}, 
this implies that this algebra is generated by certain homogeneous polynomials in {xj}j^j 
with coefficients in Q. By (8), there is a nonconstant polynomial / among them. It follows 
from the algebraic independence condition that f(v) / 0. Hence, v ^ ^" G m V [iy ^ 

Note that the basis and the set mentioned in Proposition 2 always exist because there 
exists a Z-form of q defined by the Chevalley basis and an admissible Z-form of V (see, for 
example, [Hu]). For the adjoint representation, these basis and set are given by the Z-form 
of the algebra g. 

2.9. If the number of orbits in a null-cone is finite, then the strata do not necessarily 
coincide with orbits (see Example 3 in Section 4). It would be interesting to find out 
whether it is always possible turn strata into orbits in such cases by changing the inner 
product ( , ). If this is so, then our algorithm yields a classification algorithm for the 
nullforms of any visible representation [Kai], [Ka2]. 
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3. Algorithm 



First, we present a number of additional notations and definitions concerning geometry and 
certain special graphs. 

3.1. Let E be a finite-dimensional linear Euclidean space over Q and let M be its 
nonempty subset. Introduce the following notation (Fig. 1): 

• aff M is the afhne hull of the subset M in E (i.e., the minimal linear variety in E that 
contains M); 

• conv M is the convex hull of M in E, 

• perpM is the perpendicular dropped from zero onto aff M (i.e., the unique vector 
from aff M that is orthogonal to the difference of any two vectors from aff M). 




Fig. I 

3.2. Consider a rooted tree V (i.e., a connected graph without cycles and with a 
selected vertex called a root). Let vo, . . . , Vd be the set of its vertices and let v$ be its root. 
We endow each edge with an orientation (by specifying its beginning and end) directed 
"from" vo, i.e., so that any vertex different from the root is the end of precisely one edge 
(this requirement uniquely defines the orientation of edges). Figure 2 on the next page 
shows precisely such an orientation. 

For any two different vertices V{ and Vj , there exists at most one route with the beginning 
at Vi and the end at Vj, that passes along edges. If such a route exists, we call it a geodesic 
connecting Vi with Vj. The number of edges in a geodesic is called its length. For instance, 
the vertices v% and V20 in Fig. 2 are not connected, but the vertices v\ and V21 are connected 
by the geodesic, and its length is 4. The root vq is connected by a geodesic with any vertex. 

A vertex is called the end vertex if it is not the beginning of any edge. For instance, 
the following vertices are end vertices in Fig. 2: V2, V4, vq, vs, «io, fn, ^13, i>i4, ^5, vn, 
vis, v 2 o v 2 i- 

Each vertex is connected by a geodesic with at least one end vertex. The height of a 
vertex Vi is the greatest length of geodesies that connect Vi with end vertices. For instance, 
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in Fig. 2 the root vq has the height 5, the vertex v% has the height 3, and the vertex vn has 
the height 0. The end vertices are exactly the vertices of height 0. 




Fig. 2 

If, moving along a geodesic 7, we write out all successively encountered vertices, then the 
sequence of vertices obtained is called a geodesic sequence corresponding to 7. For instance, 
if 7 in Fig. 2 is a geodesic connecting the root vq with the vertex V21, then 7 corresponds to 
the the geodesic sequence of vertices vq, vi, vj, v%2, fig, «21- Maximal geodesic sequences 
of vertices (i.e., those that cannot be embedded into geodesic sequences of greater length) 
correspond to 7 such that start at the root and end at an end vertex. For example, vq, V3, 
vs in Fig. 2 is a maximal geodesic sequence of vertices. 

3.3. Passing to the construction of the algorithm, consider a nonzero element I G t(Q). 
Suppose that the set of weights 

A VtT [l] := A v ^ T n{l = 1} (15) 

that lies on the hyperplane {I = 1} is nonempty. By (6), this is equivalent to the condition 
V[l] + {0}. 

Consider an orthogonal projection 

pr,:t(Q)— ^t[i](Q). 
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By (5) and (6), the system of weights Ayp, r m of the torus T[l] in V[l] has the form 

A V[l],T[l] = P r /( A V,TW) (16) 

and equality (16) holds with the mutiplicities of the weights taken into account if we assume 
that the latter are preserved under the projection pr z . 

Proposition 3. Let M : = A VT [l]. If I is a stratifying element, then (see Fig. 3) 

perp Me conv M, (17) 
perp M = perp {I = 1}. (18) 




M={a„ . . . , a 4 } 



Fig. 3 



(19) 



Proof. If I is a stratifying element, then 

£ conv pr^M. 

Indeed, if inclusion (19) did not hold, then, by (16), each T[/]-orbit in V[l] would contain 
zero in its closure (see, for example, [PV, 5.4]), and, hence, V [i\ = m s P^ e OI " the 
fact that I is a stratifying element. 

Since the projection pr ; commutes with taking convex hull and the only vector of the 
hyperplane {I = 1} that is mapped by pr ; to zero is perp {1 = 1}, inclusion (19) is equivalent 
to the inclusion 

perp {1 = 1} e conv M. (20) 

Since aff M C {/ = 1}, the vector perp = 1} is orthogonal to the difference of 
any two vectors from aff M. By the inclusion conv M C aff M and the uniqueness of the 
perpendicular dropped from zero onto a linear variety, inclusion (20) implies (18). In turn, 
(18) and (20) imply (17). □ 



3.4. We now introduce certain finite subsets in t(Q) determined by the G-module V . 
Namely, consider the orbits of the Weyl group W G T on the set of all nonempty subsets of the 
system of weights Ay T and fix a representative in each subset. Among these representatives, 
we choose those representatives M, that share the following properties: 
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(i) perpM / 0, 

(ii) perpM G convM, 

(iii) M is the intersection of the system of weights A VT with the hyperplane 
passing through the end of the vector perpM and orthogonal to this vector, i.e., 

perp M 

M = A VT n {l M = 1}, where l M ■ 



||perpM|| 2 ' 
(iv) for I = l M , inequality (12) holds. 

When M runs over the whole family of representatives possessing properties (i)-(iv), 
the vector l M runs over a certain finite subset £ GTV in t(Q). 

If the G-module V is trivial (i.e., A VT = {0}), then £ GTV = by (i). In particular, 
this is so if G is the identity group {e}. If the G- module V is nontrivial, then there exist 
nonzero nullforms in V (for example, vectors from for nonzero [i £ A VT )); hence, 
there are strata in W G v that are different from {0}. According to the previous discussion, 
these strata are exhausted, without repetition, by varieties of the form H[l], where I is a 
stratifying vector from £ G TV . In particular, £ GTV ^ in this case. 

Thus, the algorithm for describing all strata of the null-cone N G v of any nontrivial G- 
module V will be obtained if we find an algorithm for verifying whether or not / 6 £g,t,v 
is a stratifying element. That is what we shall now do. 

3.5. To this end, we consider the following subset in £ GTV : 



^G,T,V 



{*e£ G)T)F |#{Z<0}n$ fl , T = E dim ^}- (21) 



At€{/<1} 



This subset "governs" the coincidence of N G v with V. Namely, if the G-module V is 
nontrivial, then (21) and Corollary 2 of Theorem 1 imply that the existence of a stratifying 
vector / in 9JJ G T v is equivalent to the equality M G v = V, and that, for such I, the stratum 
H[l] is open in V. Since different elements from 9Jt GT y lie in different IV^T-orbits, the 
openness of T-L[l\ in V and claim (3) of Theorem 1 imply that only one such an element I 
may exist. Note the particular case: 

^G,T,V = => ^G,V + V. (22) 

Implication (22) also holds for trivial G-modules V, since, for these modules, M G v = {0} ^ 
V and Wl G T v = by virtue of £ G TV = 0. 

3.6. Henceforth, we assume that the G-module V is nontrivial and pass to the algorithm 
for verifying whether or not / G £ G T v is a stratifying element. Since v ^ is a closed 
subset in V[l], condition (8) is equivalent to the fact that the element I satisfies the inequality 

d[m ^G[i],V[i] <dimV[l]. (23) 
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In turn, because the number of strata is finite and these strata are open in their closures, 
inequality (23) is equivalent to the fact that the dimension of all strata of the variety 
Nqu-i yj;j is strictly less than dimy[/]. As is shown above, the latter is equivalent to the fact 
that not a single element of the set 97tG[«],T[i],v[z] determines the stratum of the null-cone 
^G[i] v[l]> *" e '' no e ^ emen t element /' G 9JIg[i],t[i],v[i] satisfies the following inequality: 

dim ^G[l]nv[l][V] < dimV[l][l']. (24) 

Applying these arguments to the G[/][/']-module V^[Z] [Z'], we obtain that (24) is not 
fulfilled precisely when there exists an element I" in the set 9^G[Z][Z'],T[i][Z'],y[z][i'] that determi- 
nes the stratum of the null-cone A/" G ^j z ,] v[i][i'] > i ,e- > sucn stratum that the following inequality 
is fulfilled: 

dimAr Gm']invm'][i"] < dimv[i][i'][i"}. 

An so on. 

3.7. This brings us to the consideration of all possible sequences of the form 
h,...,l d , where h = l, and l^\ € ^■G[h]...[ii],T[i 1 }...[i i ],v[i 1 ]...[i i ] for i = l,...,d-l. (25) 

By (4) and (6), for each of these sequences, the space V^/i]...^] is nonzero and G[l\]...[ld] 
is a connected reductive group of rank rkG — d. Thus, d ^ rkG. The sequence (25) is 
maximal (i.e., nonextendable to the right) if and only if ^G[h].4l d ],T[h].4i d ],v[h]...[i d ] = 0; in 
this case, it follows from (22) that 

^G[h]...[l d ],V[h]...[l d ] + V[h]...[l d ]. (26) 

3.8. Let us associate with vector I 6 £ GTV a rooted tree T/, whose edges are directed 
"from" the root (see Subsection 3.2). This tree is successively constructed by the following 
procedure (see Fig. 4 on the next page) : 

• I is the root of Ti. 

• If the set 9}?g[J1,t[z],v[£] is empty, then T; consists only of the root. 

• If this set is nonempty and, say, consists of elements oi, . . . , a s , then these elements 
are vertices of T/, and exactly s edges emanate from the root that have the ends 
ai,...,a s . 

• Similarly, if the set SJtG^Iail.r^IaJ.yi/JIai] is empty, then there are no edges emanating 
from vertex ai. 

• If this set is nonempty and, say, consists of elements b±, . . . , bt, then these elements 
are vertices of T; , and exactly t edges emanate from Oj that have the ends b±, . . . , bt- 

• And so on. 

• There are no other vertices and edges in the tree T;. 
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b x b, 

Fig. 4 

3.9. The decision rule can be now formulated as follows. 

Theorem 2. Let I be an element of the set £g,tv- We assign plus or minus signs to the 
vertices of the tree T; (see Fig. 5) by the following rule (which uniquely defines this sign 
allocation): 

A minus sign is assigned a vertex if and only if there exists an edge emanating 
from this vertex whose end has a plus sign (in particular, all end vertices have 
a plus sign). 

Then, I is a stratifying element if and only if the root of the graph Ti has a plus sign. 

Remark. In fact, the proof and what has been said in Subsection 3.5 imply that the tree 
T[ automatically possesses the following special property: at most one edge emanates from 
any vertex of T[ whose other end has a plus sign. In particular, at most one edge leading 
to an end vertex emanates from any vertex. 




T 
-• 



Fig. 5 



Proof. Sequences (25) are geodesic sequences of vertices of the tree Ti, that start at the 
root. Consider a vertex a and the geodesic 7 connecting the root / with a. Let h,... ,la, 
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where Id = a, be sequence (25) corresponding to 7. Let us prove by induction on the height 
of the vertex a that a plus sign is assigned the vertex a if and only if condition (26) holds. 
By the definition of the stratifying element, for a vertex of maximal height, i.e., for a = /, 
this gives the assertion of the theorem. 

If a has a zero height, then a is an end vertex. Therefore, the sequence l\, . . . ,ld is 
maximal, and, hence, as was mentioned above, inequality (26) holds. On the other hand, 
by the sign allocation rule, the vertex a has a plus sign in this case. Thus, the assertion of 
the theorem holds for vertices of zero height. 

Now, suppose that a is a vertex of nonzero height. Then, sequence (25) is nonmaximal, 
i.e., the set ^lG[h}...[i d ],T[i 1 }...[i d ],v[i 1 ]...[i d } is nonempty. As was shown in Subsection 3.6, condi- 
tion (26) holds if and only if any element b E ^■G[h]...[i d ],T[h]...[i d ],v[i 1 ]...[i d ] does not satisfy 
the condition 

^i]...ww,v[i 1 ]...[yw^I !l ]-^I 6 l' ( 2? ) 

On the other hand, it follows from the definition of the graph Ti that b is its vertex and that 
the geodesic connecting the root with b corresponds to the sequence 1%, . . . ,ld,b. It follows 
from the definition of height that b has a smaller height than a. Hence, by the induction 
hypothesis, condition (27) is violated if and only if b has a minus sign. Thus, condition 
(26) is fulfilled if and only if all vertices b £ 9ytG[h]...[i d ],T[i 1 ]...[i d ],v[h]...[i d ] have a minus sign. 
However, according to the sign allocation rule, the latter is equivalent to the fact that the 
vertex a has a plus sign. This completes the proof. □ 

Corollary 1. Suppose that an element I £ £ GTV is not orthogonal to any root. Then I is 
a stratifying element. 

Proof. By (15) and (16) and conditions (ii) and (iii) in the definition of the set £ GTV (see 
Subsection 3.4), zero belongs to conv ^-ym G m- Therefore, for any nonzero element /' G V[l], 
the half-space {I' < 1} contains at least one weight. Since, by the hypothesis, there are 
no roots in V[l] condition (21) implies that 97t G ^ G m ym = Thus, the tree T t with the 
allocation of signs defined in Theorem 2 has the form shown in Fig. 6. 

/ 

+ 

Fig. 6 

Hence, I is a stratifying element. □ 
Since <3? gT = for G = T, this and (10) imply the following corollary. 

Corollary 2. (the case of a torus) If G is a torus, G = T , then 

(a) all elements of the set £ G T v are stratifying elements; 

(b) the closures of the strata are linear subspaces of the form ©„ 6conv m Vp> where M 
runs over those subsets in the system of weights A VT , that possess properties (i), (ii), 
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and (iii) pointed out in Subsection (3.4). The strata themselves are complements, in 
these subspaces, to unions of finite sets of linear spaces of a similar form. 



4. Examples 

Denote by the space of forms of degree d ^ in variables xi,...,x n over k. We 
consider this space as the G-module for G = GL„ or SL„ with respect to the natural action 
by linear transformations of variables. 

We put N:= {0,1, 2,...} and Z + := {1, 2, 3, . . .}. 

Example 1 (the case of rank 1). If dimT = 1, then, by Corollary 1 to Theorem 2, all 
elements of the set £ GTV are stratifying elements. 

Suppose that, in view of Corollary 2 to Theorem 2, the group G is not a torus. Then, 
passing to the universal covering, we can assume that G = SL2 and T is the diagonal 
maximal torus in G. The group Hom(T, k x ) is generated by the character diag(a, a -1 ) 1— > a. 
Denote it by e. Then, <3? g T = {2e,—2e}, and, since W GT = {1,-1}, we can assume that 
2,q T v = {-^y I M £ Ayr H Z + e}. Since char k = 0, we have, up to an isomorphism, V = 
F di 2 © ... © F ds 2 . Let d odd (respectively, d even ) be the greatest positive odd (respectively, 
even) number among di,. . . ,d s , if such numbers exist, and otherwise. Since A^ T = 
{cfe, (d—2)e, . . . , (2 — d)e, -de} and all the weights in A^ 2 T have mumtiplicity 1, we obtain 



d+l 



+ ^, and 



that the number of strata in J\f G v that are different from {0} is equal to 
the dimension of the stratum A^[^] , defined by the element / = ^ £ ^ G £ G T v , is equal to 
1 + Yl l d i ^m\ rn -> di \i where ~\a,b \ with o, b G Z + , a ^ b, denotes the number of integers in the 
interval [a, b], that have the same parity as b. 

For example, when s = 5 and (d\, cfo, ^2, ^5) = (2,3,3,4,5), we have d = 5, d = 4 
and £ G T y consists of + ^ = 5 elements Zj, . . . , Z5. Thus, there are exactly five strata 

that are different from {0}. The weights from A VT are depicted by circles in Fig. 7; the 
numbers at these circles are the multiplicities of these weights. The roots are marked by 
arrows. One can choose li so that the point {li = 1} is such as shown in Fig. 7. The 
dimension of the stratum %[li\ is greater by 1 than the sum of multiplicities of the circles 
lying to the left of the circle {l L = 1}; i.e., it is equal to 11, 8, 6, 3, and 2 for i = 1, . . . , 5, 
respectively. This, in particular, yields dimA/" G v = 11. 

{/ 5 =1} {/ 4 =1} {/ 3 =1} {4=1} {4=1} 

^O- O O b< ® ® @ €) — o — o — 

1 1 3 2 3 2 3 2 3 1 1 

Fig. 7 

Example 2 (the case of rank 2). Let dimT = 2. By Corollary 2 to Theorem 2, we assume 
that G is not a torus. The description of the straight lines {I = 1} for / G £ G T(/ is 
equivalent, up to the action of the Weyl group, to the description of all possible straight 
lines L on the plane t(Q) that share the following properties: 
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(i) L does not pass through 0; 

(ii) L passes at least through one weight; 

(iii) the end of the perpendicular dropped from onto L, is contained in a segment 
representing a convex hull of the weights lying on L. 

If L is such a line, then there are two possibilities: either L is parallel to no root, or 
it is parallel to a certain root a. In the first case, I is a stratifying element by Corollary 
1 to Theorem 2. In the second case, it may happen that 9Jt G m T u\ ym 7^ - Namely, since 
is invariant with respect to W GT and, in particular, with respect to the reflection 
about a straight line orthogonal to a, it follows from (21) that this occurs precisely when 
L contains exactly two different single weights (in Fig. 8, the weights are depicted by dark, 
and the roots, by light circles). 

• • {'-1} 

a -a 

{1-0} C* -i— >o 

Fig. 8 

In this case, SPtg^ T ^ v ^ consists of a single element I'. Since, obviously, SOt^] [j/j t[1][1'] v[l][i'] 
= 0, in this case the tree T[ with an appropriate sign allocation has the form shown in 
Fig. 9. 

/?- 



rl + 

Fig. 9 

Hence, by Theorem 2, I is not a stratifying element. 

Example 3 (dependence on the norm; null-cones with a finite number of orbits). Let 
G = GL2 and V = F 1 2 ® A 2 F 1 2 . There are exactly three nonzero G-orbits in V: 0\ := 
G-xi, 02 := G-{x\ AX2), and C3 := G- {x\ +x\ AX2). Let T be the diagonal maximal torus 
in G and let £j E Hom(T, k x ) be the weight of the variable X{. The weights e± and 82 form 
a basis in the lattice Hom(T, k x ) and thereby in t(Q). The Weyl group W GT has order 2 
and acts by permutations of e\ and £2- The sequence of vectors x%, X2, x% A X2 is a weight 
basis in V. Therefore, the system of weights has the form = {ei,£2,£i + £2} an d the 
multiplicity of every weight is 1. The system of roots has the form $ T = {e\ — £2, £2 — £i}- 
Positive definite W G ^-invariant inner products on t(Q) are classified by the pairs of rational 
numbers (a, b) £ Q 2 , satisfying the conditions a > and a 2 > b 2 : to a pair (a, b) is assigned 

a 6 
b a 

Thus, in this case, the weights and the roots are depicted by dark and light circles, 
respectively (Fig. 10); the left part of Fig. 10 illustrates the case when b > 0, while the right 
part, the case when 6^0: 



the inner multiplication for which 



is the Gram matrix of the basis £1, £2. 
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8,+8 2 



R=i} 



{/>=!} 



£ 2 £, 



Fig. 10 



Figure 10 shows that the set £ G T y consists of three elements li,fo, and Z3 for b > and 
of four elements 1%, I2, 13, and Z4 for 6^0, and that, subjecting these elements, if necessary, 
to transformations from the Weyl group, one can assume that the straight lines {/j = 1} 
are such as they are depicted in Fig. 10. According to Example 2, if b > 0, then there are 
exactly two strata in the null-cone N G v that are different from {0}, namely, 7i[h] and 
Hlh]', if b ^ 0, then there are exactly three such strata, namely, Hih], and 

It is clear that, if b > 0, then H[h] = 2 , and H[h] = Oi U C 3 , whereas, if b ^ 0, then 
H[h] = 2 , H[h] = Oi and H[k] = C 3 . 

Thus, in the general case, the strata depend on the norm chosen and, if the null-cone 
contains only a finite number of orbits, then some strata may even not be orbits (see [He2, 
Remark 4.10]). 

Example 4 (ternary forms). Let G = SL3 and V = F d3 , d ^ 1. Let T be the diagonal 
maximal torus in G and Si S Hom(T, k x ) be the weight of the variable xi. The space t(Q) is 
two-dimensional. The weights £1, £2, and £3 generate the lattice Hom(T, k x ) , and the sum 
of these weights is equal to 0. The system of roots $T,g is the set {si — Sj \ i 7^ j}. The set 
{£1, £2, £3} is preserved by the Weyl group Wq,t, and any permutation of the vectors £1, £2, 
and £3 is performed by a certain element from Wq,t- Therefore, || £1 || = || £2 || = || £3 ||, 
and Z{£j,£j} = 27r/3 for i 7^ j, which determines ( , ) uniquely up to proportionality. 
If 01,02,03 G Q, then we denote the vector c\E\ + C2£2 + C3£3 G t(Q) by (C1C2C3). Then, 
the system of weights is expressed as Ay T = {(C1C2C3) | c\ + C2 + C3 = d, o L G N}. The 
multiplicity of the weight (C1C2C3) is equal to 1, and the set of monomials {x^x^Xg 3 } is 
linearly independent and spans Vr clC2C3 \. Thus, the system of weights is given by the set 
of vertices of regular triangles with the side v3 || E{ \\ that form a partition of the regular 
triangle with vertices (d00), (OdO), (OOd). In Fig. 11 on the next page, the weights are 
depicted by dark circles and the roots, by light circles. 

The straight lines {I = 1} for I G £ GT y and the stratifying elements m j^q rp y are 
described according to Example 2. There is a unique, up to the action of the Weyl group, 
case when I is not a stratifying element: in this case, the straight line Lq := {/ = 1} passes 
through the weights (l(d — 1)0) and (0(d — 1)1). 
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(OdO) 

(l(J-l)O) * ■ t (Q(rf-l)l) 




((</-l)10) / .(01(rf-l)) 
(dOO) * • • • . .(0(W) 

Fig. 11 

For example, in the case of ternary quartics (i.e., when d = 4), one can easily verify 
that &gt,v contains exactly 12 elements Zj , . . . , Z12 and that, subjecting them, if necessary, 
to transformations from the Weyl group, one can assume that the straight lines {Zj = 1} 
are such as they are depicted in Fig. 12. 




Fig. 12 

Here, only I2 is not a stratifying element. Thus, there are exactly 11 strata in this case 
that are different from {0} , and these strata are given by 1 ^ i ^ 12, i 7^ 2. 

Formula (11) gives their dimensions: dim"H[Zj] = 3,8,11,7,9,5,9,10,10,7, and 8 for i = 
1, 3, 4, 5, 6, 7, 8, 9, 10, 11, and 12, respectively. Hence, dimA/" G v = 11 and M G v has a unique 
irreducible component of maximal dimension (one can show that Af G v has another irredu- 
cible component of smaller dimension [Hi]). 
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Example 5 (nilpotent elements in reductive Lie algebras). If V = Q, then J\f G v is the 
variety of all nilpotent elements of the Lie algebra g. It is well known [Hei], [SI] that, in 
this case, the strata of the null-cone M G v that are different from {0} are exactly the nonzero 
G-orbits contained in M G v , i.e., the conjugacy classes of nonzero nilpotent elements of the 
Lie algebra q. Hence, in this case our algorithm turns into the classification algorithm for the 
conjugacy classes of nilpotent elements in reductive Lie algebras g, which is reduced to only 
simple geometric-combinatorial operations with the system of roots & s ,t- For the first time, 
such a classification was obtained in [Dy] by a different method, which was later improved 
in [BC]. This classification is a particular case of the classification of the orbits of nullforms 
for the so-called ^-representations (see [Vis]). To obtain the latter classification, Dynkin's 
method was improved and extended in [Vii], [V12], [GV] to the case of ^-representations. 
A partial computer implementation of this method was obtained in [Li2]. 

We will illustrate the solution of this problem by means of our algorithm through the 
example of the simple exceptional Lie algebra 5 of type G2. In this case, the weights are 
depicted by dark circles in Fig. 13. 



Here, the roots are nonzero weights. Using Fig. 13, one can easily verify that the set 
Sjqtv contains exactly six elements l±, . . . , Iq and that, subjecting them, if necessary, to 
transformations from the Weyl group, one can assume that the straight lines {/j = 1} are as 
is shown in this figure. Of these elements, only Iq is not orthogonal to any root; for all the 
other elements li, the line {Zj = 1} contains exactly two roots precisely for i = 2 4. Hence, 
the total number of strata different from {0} is four (therefore, there are precisely four 
nonzero conjugacy classes of nonzero nilpotent elements), namely, T~L[li], where % = 1,3, 5 



{4=1} 




Fig. 13 



20 



and 6. 

The representatives of these four classes are obtained by means of what has been said in 
Subsection 2.8. Namely, it follows from Proposition 2 that, if x 7 6 g 7 is an element of the 
Chevalley basis of the algebra g, then the representatives of the classes %[/i], "Hfe], H[h], 
and are xp, tpxp + t a+ px a+ p + t 2a+ px 2a+ p + x 3a+ p, x a , and x a + tpxp, respectively, 
where tp, t a+ p, t 2a +p are elements from the field k that are algebraically independent 
over Q. 

A simple additional argument shows that these representatives can be simplified. Namely, 
according to (10) and (7), if a G[/j]-orbit of a nonzero vector v G V[k] is closed, then this 
vector lies in the class %[Zj]. The group G[li] is a one-dimensional torus T[li] for i = 6 and 
is locally isomorphic to SL2 for i 7^ 6. Therefore, in the first case, the closedness of G[li\ ■ v 
is equivalent to the fact that zero lies in the convex hull of the weights of the T^J-module 
V[Iq] that occur in the decomposition of v into a sum of weight vectors. This fact and 
Fig. 13 imply that e a + ep is a representative of the class In the second case, one can 

use the fact that, if the weights of certain weight vectors possess the following properties: 

(a) all these weights are different; 

(b) zero the an inner point of their convex hull; and 

(c) the difference of any two of these weights is not a root, 

then the orbit of the sum of these weight vectors is closed (see [DK, Prop. 1.2], [PV, 6.19]). 
This is applicable to the case of i = 3. Figure 13 shows that the roots of the group G[ls] with 
respect to the torus T[/3] are ±a, and the weights of V[ls] are the orthogonal projections 
of /?, a + j3, 2a + j3, and 3a + j3 onto the straight line {Z3 = 0}. Hence, the G[Zs]-orbit of 
the vector ep + e^ a+ p is closed. Therefore, ep + e^ a+ p is a representative of the conjugacy 
class %[h}- 

In conclusion, note that, for ^-representations, our algorithm turns into a classification 
algorithm for the orbits of nullforms. This claim results from the following proposition. 

Proposition 4. For every 9 -representation, the strata of the null-cone are orbits. 

Proof. The existence of a homogeneous version of the Morozov theorem [V14, Theorem 1] 
allows one to apply the arguments similar to those by which this fact was proved in [SI, 
Prop. 1] for the adjoint representation (in turn, these arguments were inspired by [Ka 2 , §1, 
Lemma 1.4]). □ 
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